CTN  Report 
89-008 


UCID  21691 


CALUVOD^TitOfJtC 


CALS  Test  Network 
Strategic  Plan 


October  11, 1989 


Prepared  for 

Air  Force  Logistics  Command 
AITI  Project 


D2TC 


4 


19960826  076 


Lawrence  Livermore  National  Laborator\’ 


DISTRIBUTION  STATEMENT  A 

Approved  for  public  release; 
Distribution  Unlimited 


Preface 


Testing,  relating  to  any  specification  or  standard,  requires 
certain  actions.  CALS  standards  and  specifications,  as  a  subset 
of  all  standards,  require  the  same  actions  in  testing.  The 
testing  includes:  a)  Conformance  Testing;  and  b)  User 
Application  Testing.  The  management  of  CALS  conformance 
testing,  as  an  overall  tasking,  has  been  assigned  to  the  National 
Institute  of  Standards  and  Technology;  user  application  and 
related  testing,  as  an  overall  tasking,  has  been  assigned  to  the 
CALS  Test  Network  Office. 

This  Computer-aided  Acquisition  and  Logistic  Support 
(CALS)  Test  Network  Strategic  Plan  primarily  supports  User 
Application  Testing  and  is  a  document  which  will  have 
periodic  updates.  These  will  occur  as  the  technology  of  CALS 
Standards  and  testing  grows  and  matures.  New  specifications 
may  be  required  and  existing  specifications  wiU  be  amended  as 
needs  for  corrections  and  updates  are  identified. 

This  plan  is  the  responsibility  of  the  CALS  Test  Network 
Office,  managed  by  the  Air  Force  Logistics  Command 
Logistics  Management  Systems  Center,  Technology  Support 
Office.  Any  recommendations  for  change  or  comments  about 
the  content  should  be  sent  to: 


Melvin  S.  Lammers 
CTNO  Director  and  Chief 
Technology  Support  Office 
HQ  AFLC  LMSC/SJT 
Wright-Patterson  AFB,  OH  45433-5000 
(513)  257-3085 
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CALS  Test  Network  Strategic  Plan 


Executive  Summary 

The  CALS  Test  Network  (CTN)  was  created  to  thoroughly  test,  evaluate,  and 
demonstrate  the  CALS  Standards.  It  was  set  up  under  the  direction  of  the  Office 
of  the  Assistant  Secretary  of  Defense  (OASD),  is  managed  by  the  CALS  Test 
Network  Office  (CTNO)  at  the  Air  Force  Logistics  Command  (AFLC),  with  an 
operational  laboratory  at  the  Lawrence  Livermore  National  Laboratory  (LLNL). 

The  overarching  goal  of  the  CTNO  is  to  test,  evaluate,  and  demonstrate  the 
interchange  and  functional  use  of  digital  technical  information  between  industry 
and  government  using  CALS  Standards.  A  part  of  this  goal  is  to  test,  at  the 
corporate  Department  of  Defense  (DoD)  level,  the  usability  of  the’ CALS 
standards  in  the  DoD  infrastructure,  and  eliminate  duplicate  testing  by  the  DoD 
components. 

The  CTNO  objectives  are: 

1.  Develop  a  CALS  Test  Network  for  user  application  testing  of  CALS 
Standards  under  actual  use  conditions. 

a.  Assist  in  setting  up  Service  Lead  Test  Beds. 

b.  Identify  industry  and  government  participants. 

c.  Identify  appropriate  logical  and  physical  network  linkages. 

d.  Assist  in  establishing  a  CALS  Standards  Application  Center  of 
Excellence  at  each  Service  Lead  Test  Bed. 

2.  Operate  the  CTN  and  interchange  digital  technical  data. 

a.  Demonstrate  the  CALS  Standards  over  current  user  applications. 

b.  Evaluate  the  capabilities  and  effectiveness  of  the  Standards. 

c.  Identify  needed  improvements  to  the  Standards. 

d.  Identify  requirements  for  new  digital  data  standards. 

e .  Create  CALS  Reference  Test  Sets 

f .  Assist  DoD  users  in  the  development  of  Data  Acceptance 
Testing  Procedures. 

g .  Develop  guidance  on  how  to  use  the  CALS  Standards. 

h.  Help  define  functional  application  specifications. 
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3.  Implement  a  CTN  Review  Board  (CTNRB)  of  government  members. 

a.  Review  CTN  test  plans  and  establish  priorities  for  CTN  testing. 

b.  Review  CTN  test  results  and  propose  corrective  actions. 

c.  Distribute  CTN  test  reviews  and  corrective  action  status  reports. 

Some  operational  features  of  CTN  follow: 

1 .  CTN  is  a  confederation  of  government  and  industry  participants. 

2.  The  CTN  "logical"  network  will  consist  of  existing  as  well  as  new 
facilities. 

3.  User  application  tests  will  normally  go  from  one  facility  to  another  (end- 
to-end). 

4.  Test  files  will  be  one  of  two  types,  actual  weapon  system  data  or 
reference  data  of  precisely  known  content. 

5.  Tests  will  be  planned  independently  by  the  participants,  or  by  the  Service 
Lead  Test  Beds  or  CTNO  technical  staff. 

6.  Technical  review  of  test  plans  will  be  performed  by  the  CTNO.  Test 
Plans  will  be  approved  by  the  CTNRB  before  being  sent  to  the  OSD 
CALS  Planning  (Sroup. 

7.  Test  reports  will  be  made  available  to  CTN  members  after  coordination 
with  the  participating  facilities. 

8.  Testing  will  begin  with  current  CALS  Standards  and  application 
categories,  and  will  expand  as  CALS  matures. 

9.  Each  Service  will  have  its  own  Service  Lead  Test  Bed  to  serve  as  its  CTN 
testing  focal  point. 


CALS  Test  Network  Strategic  Plan 


Goal,  Objectives,  and  Overview 


1.1  Introduction 

This  Strategic  Plan  (SP)  details  the  creation  of  a  logical  network  to  thoroughly 
demonstrate  test,  and  evaluate  the  Computer-aided  Acquisition  and  Logistic 
Support  (CALS)  Standards  (see  Appendix  C).  The  network,  known  as  the  CALS 
lest  Network,  will  be  formed  from  existing  and  new  components  within  industry 
and  L  will  be  operated  under  the  direction  of  the  CALS  Test 

Network  Office  (CTNO)  at  the  Air  Force  Logistics  Command  (AFLC)  Logistics 
Management  Systems  Center,  Technology  Support  Office  (LMSC/SJT),  for  the 

Svsiem^/rM  (OASD)  Production  and  Logistics 

Nation»wi'T'NT  is  provided  by  the  Lawrence  Livermore 

Projea  Automated  Interchange  of  Technical  Information  (AITI) 

The  focus  of  the  CALS  Test  Network  will  be  the  interchange  of  digital  technical 
f  s  defined  by  the  Department  of  Defense  (DoD)  CALS  Program, 
ine  CIN  will  be  used  to  demonstrate  and  examine  the  effectiveness  of  the  CALS 
standards  under  actual  use  conditions  and  to  check  the  functional  use  of  the 
mforniation  that  is  transferred.  Test  capability  provided  by  the  CTN  will  also  be 

present  StandardT^^^*  technologies,  both  current  and  future,  that  go  beyond 

Within  this  Strategic  Plan  are  descriptions  of  the  CTNO  overarchincr  aoal 
objecnves,  tasks,  resources,  schedules,  network,  and  participants.  The  Plan  is 

ovfr^iew  n? CTm" ri. objectives,  and  an  operational 
overview  of  CTN.  Chapter  2  details  its  operation.  Chapter  3  deals  with  general 

testing  concepts.  Subsequent  chapters  contain  plans  and  information  that  are 

specitic  to  the  CALS  application  categories;  additional  chapters  will  be  added  one 

tor  each  category,  as  the  standards  defining  the  categories  and  the  related  test 
procedures  mature. 

1.2  Overarching  Goal  of  the  CALS  Test  Network  Office 

The  overarching  goal  of  CTNO  is  to  test,  evaluate,  and  demonstrate  the 
terchange  and  functional  use  of  digital  technical  information  between  industry 


1 


and  government  using  CALS  Standards.  A  part  of  this  goal  is  to  test,  at  the 
corporate  DoD  level,  the  usability  of  the  CALS  standards  in  the  DoD 
infrastructure,  and  eliminate  duplicate  testing  by  the  DoD  components. 

1.3  Objectives 

1.3.1  Develop  a  CALS  Test  Network  for  user  application  testing  of  CALS 
Standards  under  actual  use  conditions. 


a.  Assist  in  setting  up  Service  Lead  Test  Beds  (SLTBs)  for  evaluating 
and/or  developing  test  software  and  for  performing  detailed 
analysis  of  digital  data. 

b .  Identify  industry  (contractor  or  vendor)  and  government  (DoD  or 
other  government  agency)  Test  Participants  among  existing  sites. 

c.  Identify  appropriate  network  linkages  which  may  be  "physical" 
such  as  telecommunications  links  or  "logical"  such  as  magnetic 
tapes. 

d.  Assist  in  establishing  a  CALS  Standards  Application  Center  of 
Excellence  at  each  Service  Lead  Test  Bed. 


1.3.2  Operate  the  CTN  and  interchange  digital  technical  data  to: 


a.  Demonstrate  the  technical  capabilities,  operational  suitability,  and 
functional  use  of  the  CALS  Standards  over  the  complete  range  of 
DoD  and  industry  user  applications. 


Evaluate  the  capabilities  and  effectiveness  of  the  CALS  Standards. 
Identify  needed  improvements  to  the  Standards. 

Identify  requirements  for  new  digital  data  standards. 


e.  Create  Reference  Test  Sets  for  all  application  categories,  with  their 
various  types  and  classes,  covered  by  the  CALS  Standards. 

f .  Assist  DoD  users  in  the  development  of  Data  Acceptance  Testing 
Procedures,  then  demonstrate  its  use  on  digital  data  delivered  in 
fulfillment  of  contracts  at  DoD  sites. 


g .  Develop  guidance  (in  the  form  of  check  lists,  scenarios,  scripts,  and 
reports)  on  how  to  use  the  CALS  Standards. 

h.  Help  define  functional  application  (application  protocol) 
specifications  needed  to  apply  the  CALS  Standards  to  a  particular 
user  application  and  environment. 

1.3.3  Implement  a  CTN  Review  Board  (CTNRB)  of  government  members. 

a.  Review  CTN  test  plans  and  establish  priorities  for  CTN  testing. 

b.  Review  CTN  test  results  and  propose  appropriate  corrective 
actions. 

c .  Distribute  CTN  test  reviews  and  corrective  action  status  reports  to 
CTN  Test  Participants  and  the  CALS  community. 

1.4  Operational  Overview 

1.4.1  The  CTN  is  a  confederation  of  government  and  industry  agencies.  Test 
Network  Participants  fall  into  three  categories:  Government  Test  Participants, 
Industry  Test  Participants,  and  Service  Lead  Test  Beds  (see  Subsection  2.4.2). 

1.4.2  The  CTN  "logical"  network  will  consist  of  existing  as  well  as  new 
facilities.  This  will  help  keep  implementation  costs  down  (see  Section  3.1). 

1.4.3  CTN  user  application  testing  will  focus  on  complete  (end-to-end) 
transfers  of  actual  weapon  system  data.  This  will  help  ensure  actual  use 
conditions  and  will  utilize  existing  sites  (see  Subsection  3.2.1). 

1.4.4  Test  files  will  be  one  to  two  types,  actual  weapon  system  data  or 
reference  data  of  precisely  known  content  (see  Section  3.3). 

1.4.5  There  are  two  types  of  user  application  tests:  (1)  Independently  Planned 
Tests  (IPTs)  -  those  planned  and  executed  independent  of  formal  CTNO  funding 
and  coordination  by  industry  or  government  entities,  and  (2)  CTN  Planned  Tests 
(CPTs)  -  those  planned  and  executed  by  the  Service  Lead  Test  Beds  or  the  CTNO 
with  formal  CTNO  funding  and  coordination.  Both  types  of  test  will  be 
published  by  the  CTNO  and  have  summary  test  results  loaded  on  the  CTNO 
Information  Exchange  (Info-X)  bulletin  board.  CPTs  will  have  detailed  analysis 
of  the  test  data  prepared  by  the  Service  Lead  Test  Bed  or  CTNO  staff.  For  IPTs, 
CTNO  will  provide  a  checklist  that  can  be  used  both  to  guide  the  digital  transfer 
and  to  systematically  record  the  results. 
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1.4.6  Technical  review  of  test  plans  will  be  performed  by  the  CTNO.  Test 
Plans  will  be  approved  by  the  CTNRB  before  being  sent  to  the  OSD  CALS 
Planning  Group.  Service  Lead  Planners  will  be  responsible  for  generating  test 
plans  from  their  respective  components  (see  Subsections  2.3.1  and  2.3.3). 

1.4.7  Preliminary  test  reports  will  be  made  available  to  CTN  members  on  the 
CTN  Information  Exchange  network  shortly  after  each  test,  and  after 
coordination  with  the  participating  facilities  (see  Subsections  2.2.3  and  2.4.3). 

1.4.8  Testing  will  begin  in  the  application  categories  of  Technical  Publications 
and  Engineering  Data,  utilizing  MIL-STD-1840A,  MrL-D-28000,  MIL-M-28001, 
MIL-R-28002,  and  MIL-D-28003.  Expansion  to  the  other  application  categories 
will  occur  as  CALS  Standards  mature  (see  Subsection  2.1.2  and  2.2.1). 

1.4.9  Each  Service  will  have  its  own  Service  Lead  Test  Bed  to  serve  as  its  CTN 
testing  focal  point  (see  Subsection  2.4.2). 


1.5  Functional  Relationships  within  CTN 

1.5.1  The  functional  relationship  of  the  CTNO  with  its  constituent  test 
participants  is  shown  in  Figure  1.  Referring  to  the  upper  left-hand  portion  of  the 
figure,  the  downward  path  shows  the  testing  associated  with  a  repository;  the 
path  starting  to  the  right  shows  the  test  bed  functions. 
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Figure  1 
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CALS  Test  Network  Functional  Relationships 


CTN  Operational  Details 


This  chapter  contains  details  about  what  Standards  CTN  is  testing,  how  CTN  is 
organized,  how  it  functions,  and  how  it  interfaces  with  its  test  participants.  It 
also  contains  a  section  on  how  CTN  is  affected  by  future  directions  in  CALS. 

2.1  Technical  Structure  of  CALS  Testing 


2.1.1  Application  Categories  and  Other  Areas  of  Testing 

CALS  Standards  eventually  will  apply  to  the  broad  application  categories 
described  below.  Coverage  of  these  application  categories  by  current  CALS 
Standards  is  indicated  in  Figure  2.  Initial  CTN  activities  are  focused  on  testing 
transfers  in  the  first  four  categories:  Technical  Publications,  Engineering  Data, 

Acceptance  Procedures  development  and  testing.  The 
LINO  will  monitor  progress  in  the  development  and  testing  of  the  standards  in 
me  category  of:  Data  Protection  and  Security.  During  FY-90  the  CTNO  will 

begin  addressing  Data  Configuration  Management  and  Small  Business 
Capabilities. 


2. 1.1.1  Technical  Publications 


Technical  Publications  are  textual  documents  that  may  also  contain,  illustrations 
images,  and  tables.  Examples  of  Technical  Publications  (Tech  Pubs)  are  technical 
manuals  and  technical  orders.  See  Chapter  4  for  details  on  the  testing  of  Tech 

Pnnc  tramc-foT-c  ^  ^  wwia 


2. 1.1. 2  Engineering  Data 

Engineering  Data  is  currently  defined  as  technical  information  relating  to  parts 
assemblies,  and  subsystems  used  to  describe  a  weapon  system.  The  information 
may  pertain  to  design,  analysis,  manufacture,  test,  inspection,  procurement,  and 
reprocurement.  Examples  of  Engineering  Data  are:  (1)  hard  copy  engineerin<^ 
drawings  and  (2)  digital  (raster  or  vector)  data  containing  2D  drawings,  2D 
views,  and  3D  models  with  associated  entities  such  as  notes  or  tolerancel  ’  See 
Chapter  5  for  details  on  the  testing  of  Engineering  Data  transfers. 
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2. 1.1. 3  Support  Data 


Support  Data  includes  on-line  logistic  support  analysis  data.  As  part  of  CALS 
^nase  11,  Support  Data  and  Engineering  Data  are  to  be  combined  into  an 
Integrated  Weapon  System  Data  Base  (IWSDB). 

2. 1.1. 4  Data  Acceptance  Procedures 


Army/Air  Force 

DSREDS/EDCARS  systems  and  will  be  expanded  to  include  all  technical  data 
across  all  components  of  the  DoD. 


2. 1.1. 5  Data  Protection  and  Security 

Data  Protection  and  Security  will  be  addressed  in  the  future.  It  will  include 
encryption/decryption  techniques,  tempest,  and  security  procedures  used  to 
protect  proprietary  and  sensitive  information  from  unauthorized  access  and 


2. 1.1. 6  Data  Configuration  Management 

As  the  Services  ramp  up  their  use  of  digital  technical  data,  a  growing  need  for 
data  configuration  management,  becomes  crucial.  Under  this  general  headin'^ 
comes  toa  Configuration  Management  itself.  Indexing,  and  Data  Dictionarv 

During  FY-90,  the  CTN  wiU  begin  to  address  these  areas  of  testing  as  additions  to 
the  tour  areas  currently  underway. 


a.  Data  Configuration  Management  addresses  the  problems  of  data 
update,  interoperability  of  data  in  data  bases,  syncronicity  of  data, 

''^srsion  control,  and  other  related  topics.  For 
the  CALS  concept  to  work  in  the  CALS  Phase  II  and  beyond 
environment,  all  of  these  issues  must  be  resolved  and  tested. 

b .  todexing  addresses  the  query  capability  of  a  system  and  is  pivotal  to 
location  of  elements  of  data  in  a  family  of  data  bases.  Consistent 
indexing  principles  must  be  developed  and  tested  which  operate 
across  the  multitude  of  heterogeneous  systems  present  in  the  DoD. 
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c.  The  Data  Dictionary  standard  controls  consistent  naming 
conventions  across  multiple  data  bases  of  technical  data.  Use  of  this 
concept  reduces  the  misnaming  of  data  elements  and  subsequent  loss 
of  data.  Testing  of  a  standard  data  dictionary  is  critical  to  the 
CALS  concepts. 

2. 1.1. 7  Small  Business  Capability 

nAT^c  concept  pushes  to  the  small  business  tier  of  suppliers  of  standard 

LALS  data,  testing  of  the  interaction  between  these  firms  and  the  small  systems 
being  used  is  critical  to  the  continuing  enablement  of  CALS.  Testing  programs 
wi  be  planned  in  FY-90  to  demonstrate  further  the  transparency  of  the  standards 
across  the  small  platforms  typically  used  by  small  businesses. 
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Application  Categories 


Standards 

Application 

Categories 

MIL-STD 

1840A 

MIL-D 

28000 

IGES 

MIL-M 

28001 

SGML 

MIL-R 

28002 

Raster 

MIL-D 

28003 

CGM 

MIL-STD 

1388-2B 

(draft) 

Technical  Publications 

V 

V 

V 

V 

Engineering  Data 

V 

V 

V 

Suppon  Data 

Data  Acceptance 
Procedures 

Data  Protection  and 
Security 

Data  Configuration 
Management 

Figure  2 

2.1.2  CALS  Standards  and  Specifications 

CALS  Standards  implement  existing  and  emerging  national  and  international 
standards.  However,  efficient  implementation  by  DoD  and  industry  of  CALS- 
related  technologies  requires  more  than  simply  adopting  an  indust'ry  standard. 
(^ALS  must  agree  on  an  explicit,  unambiguous  implementation  of  the  Standard  by 
choosing  a  set  of  options  and  user  conventions  (known  as  subsets,  profiles, 
protocols,  etc.)  that  meet  the  technical  requirements  of  DoD  and  the  defense 
industry  m  the  most  efficient  manner  possible. 
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ALS  Phase  I  focuses  on  standards  for  digital  interchange  of  technical 
imornation  among  dissimilar  computer  systems.  CALS  Phase  II  focuses  on  the 
tandards  needed  to  access  and  manage  data  within  a  distributed  database.  As 
CALS  IS  implemented  throughout  DoD  and  the  defense  industry,  both  types  of 
standards  will  be  needed  to  provide  interoperability  among  design 
manufacturmg,  and  support  functions. 

The  of  CALS  Standards  were  developed  and  coordinated 

dunng  1987  (Phase  I.O)  and  1988  (Phase  I.l).  MIL-STD  1840A,  "Automated 
Interchange  of  Technical  Information,"  is  the  parent  document  for  a  family  of 
military  specifications  through  which  the  CALS  standards  will  be  published.  It 
provides  the  rules  for  orpnizing  files  of  digital  data  into  a  complete  file 

mT'"n  ^  manual  composed  of  MIL-M-28001  tagged  text, 

MIL-D-28003  vector  graphics,  and  MIL-R-28002  raster  graphics. 

Curremly,  M^-STD-1840A  (1840 A)  references  the  following  four  military 
specifications  (see  Appendix  C  for  detailed  descriptions): 


a. 


b. 


MIL-D-28000,  "Digital  Representation  for  Communication  of 
Product  Data:  IGES  Application  Subsets." 

MIL-M-28001,  "Markup  Requirements  and  Generic  Style 
Specification  for  Electronic  Printed  Output  and  Exchange  of  Text." 

c.  MIL-R-28002,  "Requirements  for  Raster  Graphics  Representation 
m  Binary  Format." 

d.  MIL-D-28003,  "Digital  Representation  for  Communication  of 
Illustration  Data:  CGM  Application  Profile." 

Also  within  the  CALS  family  is  MIL-HDBK-59,  "CALS  Program 
Implementation  Guide."  This  is  a  military  handbook  that  provides  information 
and  guidance  to  personnel  responsible  for  the  acquisition  and  use  of  weapon 
system  technical  data.  Its  purpose  is  to  assist  in  the  transition  from  paper- 
intensive  processes  to  digital  data  delivery  and  access.  It  also  supports  the 
structurmg  of  contract  requirements  to  achieve  integration  of  various  contractor 
automated  capabilities  for  design,  manufacturing,  and  logistic  support. 
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Another  CALS  standard  is  MIL-STD-1388-2B.  ■’DoD  Requirements  for  a 

Standard,  currently  in  draft 
rm,  IS  to  establish  st^dard  requirements,  data  element  definitions,  data  field 

Record  requirements  for  Logistic  Support  Analysis 

2.2  Organization  of  CTN 


This  section  details  the  background,  organizational  structure,  and  reviewin<^ 
process  that  will  be  implemented  to  help  CTN  meet  its  goal  and  objectives. 

2.2.1  Background 


The  CTN  planning  began  during  the  first  quarter  of  FY-88  CTN 
implementation  began  during  the  second  quarter  of  FY-88.  The  Initial  6peratin<^ 
Capability  (IOC)  was  third  quarter  FY-88  with  Full  Operating  Capability  (FOC) 
expected  in  the  fourth  quarter  of  FY-89.  &  y  ) 

FOC  for  FY-89  will  be  in  the  appHcation  categories  of  Technical  Publications  and 
Engmeermg  Data.  Future  CTN  efforts  will  deal  with  the  forthcoming  application 
areas  of  Support  Data,  Data  Protection  and  Security,  and  Data  Configuration 
Manapment  (see  Subsections  2.1.1  and  2.1.2.).  As  the  Standards  mature  and  as 

new  standards  are  developed,  CTN  wiU  adjust  its  focus  and  schedule  accordinc^iy 
(see  Section  2.5).  ®  ^ 

2.2.2  Organizational  Structure 


CTN  wiU  be  directed  and  coordinated  by  the  Office  of  the  Assistant  Secretary  of 
tJetense,  with  lead  management  responsibility  assigned  to  the  CALS  Test 
Network  Office  Air  Force  Logistics  Command,  Logistics  Management  Systems 
Center,  Technology  Support  Office.  The  CTNO  has  assigned  the  technical 
peration  of  the  CALS  Test  Network  to  the  Lawrence  Livermore  National 
Laboratory  under  the  Automated  Interchange  of  Technical  Information  Project. 


AFLC  has  appointed  a  CTNO  Director  and  Assistant.  A  CTNO  Operations 
Manager  and  Deputy  have  been  selected  at  LLNL.  A  Lead  Analyst  has  been 
appointed  for  each  application  category  and  for  each  specification  within  the 
Standards.  A  Test  Coordinator  has  been  appointed  to  help  review 
coordinate,  and  process  tests.  See  Appendix  E  for  a  listing  of  the  lead  CTNO 
technical  staff  members. 
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Sen'ice  Lead  Planners  have  been  appointed  by  each  of  the  Services.  They  are  the 
Service  CTNRB  members  and  are  responsible  for  development  and  coordination 
or  their  respective  Service's  CALS  Testing.  They  have  delegated  authority  to  the 
respective  SLTBs  for  test  planning  and  execution. 

Service  Lead  Test  Beds  have  been  established  at  each  DoD  Service.  Each  such 
test  bed  has  been  given  lead  responsibility  for  testing  in  an  application  category. 
See  Subsection  2.4.2  for  more  details  about  Service  Lead  Test  Beds. 

2.2.3  Review  Board 

A  CTN  Review  Board  has  been  established  to:  (1)  provide  independent  reviews 
of  test  plans  and  test  results,  (2)  prioritize  CTN  testing,  (3)  propose  and  monitor 
corrective  actions  as  appropriate,  (4)  distribute  reports  on  CTN  progress  and 
Board  reviews,  and  (5)  coordinate  CTN  support  for  CALS  development  and 

implementation.  CTNO  will  support  the  CTNRB  in  the  review  and  distribution 
of  test  results. 


a.  The  CTNRB  is  chaired  by  the  CTN  Director  (HQ  AFLC 
LMSC/SJT).  Members  have  been  selected  from  the  Department  of 
the  Army,  Department  of  the  Navy,  Department  of  the  Air  Force, 
Lawrence  Livermore  National  Laboratory,  National  Institute  of 
Standards  and  Technology,  Defense  Quality  and  Standardization 
Office,  and  other  invited  government  agencies.  An  advisory 
member  from  OSD  CALS  office  has  also  been  selected. 

b.  A  CTN  Information  Exchange  has  been  developed  and  is  being 
maintained  by  LLNL.  It  supports  the  CTNRB  by  providing  a 
computer  database  connected  to  an  electronic  mail  network  for  the 
collection  and  immediate  distribution  of  CTN  test  results  to  CTN 
members.  This  database  contains  documentation  on  the  results  of 
both  IPTs  and  CPTs  as  well  the  status  of  necessary  corrective 
actions  associated  with  those  test  results.  Info-X  data  that  has  been 
reviewed  and  approved  by  the  CTNRB  or  its  Chairman  will  be 
available  to  the  general  public  on  the  CALS  Bulletin  Board, 
maintained  by  the  National  Institute  of  Standards  and  Technology 
(NIST).  Preliminary  test  reports  will  be  made  available  on  Info^X 
after  coordination  with  the  specific  Test  Participants.  Instructions 
and  passwords  for  accessing  the  CTN  Info-X  will  be  provided  to 
CTN  members  upon  joining  the  CTN. 
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2.3  CTN  Operational  Model 


The  CTN  Operational  Model,  shown  in  Figure  3,  describes  the  operations  of  the 
CTN  and  its  component  parts.  The  flow  through  the  model,  as  depicted  by  the 
arrows,  shows  what  would  occur  in  a  typical  situation. 

The  model  is  designed  to  be  executed  by  the  CTNO,  CTNRB,  OSD  Planning 
Group,  Service  Lead  Planners  and  Service  Lead  Test  Beds  at  the  management 
level.  The  most  significant  time  of  execution  is  just  prior  to  the  beginning  of  the 
fiscal  year.  The  overall  plans  for  the  year  are  laid  out  by  the  CTNRB  at  that  time 
and  the  priorities  for  funding  and  action  are  set.  At  each  of  the  next  three 
quarterly  meetings  of  the  CTNRB,  the  priorities  and  decisions  made  at  the 
beginning  of  the  year  are  reviewed  to  see  if  changes  should  be  made. 

Each  of  the  elements  of  the  model  or  "bubbles",  are  described  below.  This 
description,  in  the  whole,  is  the  charter  of  the  CTN,  the  CTNO,  the  Service  Lead 
Planners,  and  Service  Lead  Test  Beds. 

2.3.1  User  Priorities 

During  the  fourth  quarter  meeting  of  the  CTNRB,  user  priorities  for  testing  in 
CALS  capability  areas  and  specific  test  requirements  are  set  for  the  coming  year. 
Each  of  the  Service  Lead  Planners  will  survey  their  Service  prior  to  the  meeting 
and  present  that  Service's  priorities  for  testing.  Each  priority  will  be  reflected  in 
the  form  of  proposed  tests  as  designed  by  the  Service  Lead  Planners. 

The  CTNRB  will  review  these  priorities  for  each  Service  and  decide  on  the 
overall  CTN  priority  set.  The  final  priority  will  be  decided  by  the  CTNRB 
members  and  forwarded  to  the  CTNO  for  inclusion  in  the  Stratesic  Plan. 

Also  at  this  time,  the  CTNRB  will  review  the  SP  and  recommend  updates  to  the 
CTNO.  The  CTNO  has  the  responsibility  to  write  the  SP  and  revise  it  as 
required. 
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CALS  Test  Network  Operational  Model 


2.3.2  Strategic  Plan 

Upon  receipt  of  the  User  Priorities  and  proposed  tests,  the  CTNO  will  prepare 
the  Strategic  Plan  Fiscal  Year  Annex  (SPFYA)  for  the  upcoming  year.  The 
o  overall  strategy  for  testing  and  demonstration  of  the 

SPFYA,  sets  the  testing  course  for  the  year.  The 
SPFYA  wiU  be  reviewed  quarterly  by  the  CTNRB  and  updated  as  required. 

^  SPFYA,  the  CTNO  is  responsible  for  preparing  the  new  fiscal 

year  CTOO  Financial  Plan  (FP).  The  FP  will  align  to  the  CTNRB  priorities  and 
proposed  tests. 

Also  at  this  time,  the  CTOO  will  review  the  recommended  changes  to  the  SP  and 
any  other  changes  which  are  needed  due  to  policy  changes,  test  results  or 
changes.  If  required,  the  SP  will  be  republished  along  with  the  new 
SP^A.  After  approval  by  the  members  of  the  CTNRB,  the  SP  and  SPFYA  will 

be  forwarded  along  with  the  CTNO  FP  to  the  OSD  CALS  Planning  Group  for 
approval.  ®  ^ 

Planning  Group  will  review  and  approve  the  SP,  SPFYA,  and 
the  CTNO  FP,  and  prepare  a  fiscal  guidance  letter  which  sets  forth  the  directions 
ui  testing  which  have  been  approved  for  detailed  planning  and  execution. 

2.3.3  Priority  Tests 

^ch  of  the  priority  areas  and  related  proposed  tests  will  have  Outline  Test  Plans 
(OTPs)  submitted  by  the  Service  Lead  Planners.  The  test  plans  will  address  gaps 
in  the  testmg  of  the  standards  or  specific  areas  which  need  further  testing  due  to 
changed  circumstances.  These  outline  test  plans  will  also  incorporate  any  other 
test  proposals  as  forwarded  by  the  Service  Lead  Test  Beds. 

Together,  this  package  of  OTPs  which  have  followed  the  priorities  set  by  the 
CTNRB  and  also  foUowed  the  fiscal  guidance  provided  by  the  OSD  (Office  of  the 
Secretary  of  Defense)  CALS  Planning  Group,  will  be  forwarded  to  the  CTNO 
for  technical  and  administrative  review. 
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2.3.4  Technical  Review 


The  CTNO,  upon  receipt  of  the  OTPs,  will  review  for  technical  adequacy  and 
provide  suggested  revisions  to  the  Service  that  submitted  each  plan.  These  plans 
will  be  checked  for  duplication  with  other  tests,  suitability  of  the  test  to  the 
standard,  completeness  of  the  test,  adherence  of  the  documentation  to  the  CTNO 
documentation  standards,  completeness  of  the  documentation,  and  adherence  to 
fiscal  guidance.  These  outline  test  plans  will  be  forwarded  to  the  CTNRB  for 
review  and  approval.  The  CTNRB  will  forward  the  OTPs  to  the  OSD  CALS 
Planning  Group  for  funding  approval. 

2.3.5  Funding  Approval 

The  OSD  CALS  Planning  Group  will  review  the  OTPs  and  authorize  the  CTNO 
to  disburse  funds  to  the  Service  Lead  Test  Beds  for  obligation  of  funds,  detailed 
planning,  and  execution  of  the  test  plan. 

2.3.6  Technical  Support 

The  CTNO  will  also  provide  technical  support  to  the  Service  Lead  Test  Beds 
dunng  the  test  execution  and  test  reporting  phase.  Examples  of  this  support  are 
supplying  Reference  Test  Data  Files,  test  procedures,  technical  advice,  CTNO 

developed  testing  tools,  specialized  technical  training,  and  on-site  expert  technical 
support. 


Training  and  on-site  support  wiU  be  negotiated  with  the  Service  Lead  Test  Beds 
on  a  case-by-case  basis,  as  required. 

ms  technical  support  will  be  available  during  all  phases  of  the  CTN  Operational 

Model.  Requests  for  technical  support  should  be  sent  to  the  CTNO  Director 
(see  Appendix  E). 

2.3.7  Test  Results  and  Follow-up 

The  Service  Lead  Test  Beds  will  execute  the  test  plan  and  provide  documentation 
of  test  results  in  the  format  specified  by  the  CTNO.  Included  will  be  detailed 
documentation  of  any  areas  where  the  CALS  Standards  need  revision. 
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TJiese  suggested  revisions  along  with  the  test  reports  will  be  forwarded  to  the 
CTNO.  The  CTNO  will  document  the  revisions  in  a  separate  document  and 
forward  both  the  revisions  report  and  the  test  report  to  the  CTNRB  for  review 
and  approval. 

The  CTNRB  will  review  and  approve  the  test  report  and  CALS  Standards 
revisions  report.  The  revisions  report  will  be  forwarded  to  the  appropriate 

^andards  group  and  a  copy  of  the  report  forwarded  to  the  OSD  CALS  Planning 
Group.  ® 

The  CTNO  will  track  the  actions  taken  by  the  standards  body  to  resolve  the 
recommendations,  and  make  periodic  reports  to  the  CTNRB  quarterly  or  as 
required.  The  CTNRB  will  report  these  recommendations  to  the  OSD  CALS 
Planning  Group.  These  periodic  reports  will  summarize  test  results  and 
standards  revision  recommendations.  Included  will  be  progress  made  bv  the 
standards  groups  in  resolving  the  recommendations. 

2.4  Interfacing  with  Industry  and  Government 

2.4.1  Workshops,  Conferences,  and  Demonstrations 

The  CTNO  technical  staff  will  conduct  workshops  covering  the  CALS  Standards 
^d  testing  of  those  Standards.  The  workshops  will  be  held  in  conjunction  with 

A  major  conferences  on  CALS-related  topics  (such  as 

iNCCjA  and  GCA),  where  possible,  to  minimize  expenses. 

The  CTNO  technical  staff  will  participate  in  these  conferences  by  conductin'^ 
sessions  and  giving  presentations  that  promote  the  CTNO  objectives.  These 
conferences  provide:  (1)  large  audiences  to  whom  the  CTNO  staff  can  explain  the 
function  and  value  of  the  CALS  Standards,  and  (2)  a  forum  for  sharing  CTN  test 
results  and  receiving  comments  on  CTN  plans.  The  CTNO  staff  will  also 
organize  and  participate  in  demonstrations  of  transfers  and  Standards  testin'^  at 
conferences,  where  practical.  ® 

2.4.2  Test  Network  Participant  Categories 

^e  CTN  is  a  confederation  of  government  and  industry  agencies  as  described 
below.  Members  of  this  confederation  may  be  CTN  Test  Participants,  CTNRB 
members,  CTNO  technical  and  administrative  staff,  and  other  interested  parties. 
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^  facility  becomes  a  CTN  Test  Network  Participant  by  filling 

rMn  signing  a  Memorandum  of  Agreement 

(MOA).  T^ese  documents  describe  the  capabilities  the  participant  will  brin«^  to 

®  of  interaction  expected.  To  see  about  becoming  a 

LIN  Test  Participant,  contact  a  CTNO  Lead  Analyst,  the  CTNO  Test 

oordmator,  the  CTNO  Director,  or  the  CTNO  Operations  Manager.  Contact 
miormation  is  found  in  Appendix  E. 

There  are  three  types  of  Test  Participants  in  CTN: 


a.  Government  Test  Participants  -  These  include  the  Department  of 
Defense,  the  Services  within  DoD,  other  government  departments 
or  agencies,  and  government  research  and  development 
laboratories. 

b.  Industry  Test  Participants  -  These  include  defense  contractors, 
subcontractors,  and  vendors  of  weapon  systems  or  of  weapon 
system  related  hardware,  software,  research,  or  data. 

c.  Service  Lead  Test  Beds  -  In  order  to  provide  testing  focal  points 
for  the  major  government  components,  each  DoD'' Service  wiU 
designate  a  Service  Lead  Test  Bed.  Such  a  test  bed  may  be  a  single 
site  or  distributed  sites.  (See  Appendix  A  for  details  on  Servfce 
Lead  Test  Beds.) 


As  interchange  testing  proceeds,  the  Seiwice  Lead  Test  Beds  will 
assume  the  day  to  day  testing  responsibilities  such  as:  conducting 
Reports,  and  consulting  on  questions  about  MIL* 
STD-1840A.  The  CTNO  will  continue  to:  (1)  coordinate  and 
monitor  tests,  (2)  review  and  approve  Final  Test  Repons,  (3) 
participate  in  conferences,  (4)  interface  with  standards -making  and 
reviewing  organizations,  (5)  serve  as  the  main  contact  for  vendor 
participants,  (6)  continue  with  its  other  managerial  and 
developmental  activities,  (7)  develop  CALS  reference  data,  (8) 

develop  test  procedures,  and  (9)  provide  technical  advice  to  Service 
Lead  Test  Beds. 


Each  Service  Lead  Test  Bed  will  have  capability  in  all  the  CALS 
application  categories.  However,  key  Service  Lead  Test  Beds  will 
also_  assume  a  primary  lead  responsibility  for  testing  in  one 
application  category  as  follows: 
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Technical  Publications: 
Engineering  Data: 

Support  Data: 

Data  Acceptance  Procedures: 

Data  Protection  and  Security: 

Data  Configuration  Management : 
2.4.3  Test  Reports 


Air  Force 
Navy 
Army 
Army 

Defense  Logistics  Agency 
(DLA) 

OASD/Defense  Quality  and 
Standardization  Office 
(DQSO) 


results  of  each  test  will  be  documented  in  a  Preliminary  Test  Report  that  is  to 
e  made  available  on  Info-X  within  30  days  of  the  interchange;  a  draft  of  the 
Final  Test  Report  wiU  be  available  within  60  days.  The  Final  Test  Report  wiU 
follow  and  will  be  made  available  both  on  Info-X  and  on  paper.  Final  Test 

^ports  will  be  cleared  through  each  participating  organization  before  release 
The  fmal  report  will  include: 


A  comparison  of  the  transmitted  and  received  documents,  notin'^  their 
respective  usability;  ® 

A  summary  of  analyses  on  the  test  sets  at:  the  originating  (sending) 

facility,  the  receiving  facility,  and,  in  the  case  of  a  CPT,  the  designated 
test  bed(s); 

A  list  of  problems  and  areas  where  changes  are  recommended  to 
MIL-STD-1840A  either  for  clarification  or  to  resolve  technical 
problems. 

If  several  interchanges  involving  the  same  test  participants  occur  within  a 
relauvely  short  period  of  time,  each  interchange  will  be  documented  in  a 
relirmnary  Test  Report,  but  the  suite  of  tests  may  be  summarized  in  a  single 
Fmal  Te^  Report.  In  the  case  where  a  draft  Final  Test  Report  is  made  available 

on  Info-X  within  30  days  of  an  interchange,  the  requirement  for  a  Preliminarv 
1  est  Report  will  be  waived. 
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2.5  Plans  for  the  Future 


In  order  to  meet  its  objectives,  the  CTNO  must  be  involved  in  identifying, 
promoting,  and  monitoring  changes  and  additions  to  existing  CALS  Standards.  It 
must  also  be  aware  of  new  standards  as  they  emerge  and  must  develop  methods 
for  testing  these  standards. 

2.5.1  Changes  to  Existing  Standards 


As  CALS  Standards  are  incrementally  developed  and  new  amendments  are 
released,  the  CTNO  plans  will  be  reviewed  and  adjusted  accordingly.  This  may 

involve  changes  or  additions  to  reference  files,  test  sets,  test  kits,  test  procedures 
and  testing  software. 

Ito  addition,  one  objective  of  the  CTN  is  to  help  define  functional  application 
^Pphcation  protocol)  specifications.  These  specifications  are  subsets  of  the 
CALS  military  specifications  such  as  the  classes  within  MIL-D-28000  and  the 
types  within  MIL-R-28002.  The  main  value  of  functional  application 
specifications  is  that  applications,  such  as  technical  illustrations,  which  require 
only  a  small  subset  of  a  fuU  military  specification,  such  as  MIL-D-28000,  are  not 
forced  to  develop  and  maintain  expensive,  complicated  software  tools  that  will 
not  be  utilized.  Such  tools  are  generators  (pre-processors),  interpreters 
(receivers,  post-processors),  and  parser/verifiers.  The  CTNO  technical  staff  wiU 
help  define  new  functional  application  specifications  by  identifying  needs  and 
subsets  while  analyzing  test  data. 

2.5.2  Testing  of  New  Standards 

pie  CTNO  wiU  monitor  progress  being  made  within  the  application  categories  of 
Support  Data,  Data  Protection  and  Security,  and  Data  Configuration 
Management.  Progress  will  lead  to  the  establishment  of  standards  that  address 
these  categories. 


When  the  new  integrated  product  information  model,  known  as  the  Product  Data 
Exchange  Specification  (PDES),  is  ready,  it  will  be  combined  with  the  Integrated 
Support  Data  Base  (ISDB)  to  specify  the  initial  Integrated  Weapons  System  Data 
Base.  The  CTNO  will  continue  to  monitor  PDES  development  and  will  provide 

the  developers  of  PDES  test  procedures  with  the  results  of  CTN  test  findinss  and 
experience. 
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wiu  also  monitor  progress  in  related  areas  such  as  Logistics  Support 
Electronic  Digital  Interchange  (EDI),  Electronic  (PagelLs) 
Man^gemenUTQM)^  Concurrent  Engineering  (CE),  and  Total  Quality 

'““St  be  developed  for  standards  that  deal  with  relational 
databases,  distributed  databases,  and  query  languages.  The  CTNO  is  currently 
doing  some  prelimmary  thinking  and  technical  planning  in  this  area. 
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User  Application  Testing 


3 


3.1  Overview 

This  chapter  covers  the  broad  topic  of  CTN  testing  with  emphasis  on  user 
application  testing.  Subsequent  chapters  describe  testing  that  is  specific  to 
application  categories. 

User  application  testing  refers  to  testing  the  performance  and  usefulness  of  the 
standards  from  a  user's  point  of  view.  Such  testing  supports  the  CTNO 
overarching  goal  by  ensuring  that  digital  technical  information  is  interchanged 
under  actual  use  (realistic)  conditions  and  that  it  is  fully  functional  when  it 
amves.  End  users  will  be  involved  in  this  testing  to  see  that  usable  documents 
result  from  the  use  of  the  CALS  Standards. 

The  term  "distributed"  refers  to  the  use  of  existing  sites,  wherever  they  may  be 
as  test  participants  in  CTN.  This  is  done  to  minimize  test  facility  investments  by 
drawmg  upon  already  available  resources.  Utilization  of  existing  sites  also  helps 
to  ensure  that  the  requirement  for  actual  use  conditions  will  be  met. 

Within  the  goal  of  testing,  evaluating,  and  demonstrating  the  CALS  Standards 
under  acmal  use  conditions,  the  objectives  of  user  application  testing  are  to: 

•  Demonstrate  digital  data  interchange  to  create  confidence  and 
familiarity  with  CALS  Standards; 

•  Determine  the  bounds  within  which  the  Standards  are  effective.  The 
testmg  wiU  determine  which  data  types  are  effectively  transferred  and 
are  usable  and  which  are  not.  Results  may  lead  to  recommendations  for 
future  areas  of  expansion  to  the  Standards; 

Identify  defects  in  the  Standards  and  recommend  corrections; 

Determine  constraints  in  the  use  of  the  Standards.  Constraints  may 
reflect  technical  limitations  of  the  Standards  or  of  the  equipment  used  to 
process  transferred  information.  When  technical  limitations  are 
discovered,  the  CTNO  will  recommend  changes. 
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3.2  Definitions  and  Background 

3.2.1  End-to-End  and  Single-Ended  Tests 

From  the  point  of  view  of  network  traversal,  there  are  two  general  categories  of 
user  application  tests,  end-to-end  tests  and  single-ended  tests. 

a.  End-to-end  tests  involve  the  digital  transfer  of  a  total  product,  such 
as  an  engineering  drawing,  from  an  originating  (or  storing)  facility 
to  a  using  facility.  These  tests  have  the  advantages  that  they:  (1) 
ensure  actual  use  conditions  and  allow  for  functional  testing  of 
documents  or  data  after  they  have  been  transferred,  and  (2)  utilize 
existing  sites  (facilities).  All  end-to-end  tests  that  are  CPTs  must  be 
scheduled  with  the  CTNO  Test  Coordinator. 

b.  Single-ended  tests  are  tests  between  a  single  node  and  a  Service 
Lead  Test  Bed.  They  are  relatively  easy  to  set  up  because  they 
require  less  coordination  with  test  participants.  They  are  useful  for 
checking  CTNO  and  Service  Lead  Test  Bed  test  software  and  for 
doing  preliminary  data  acceptance  testing.  Single-ended  tests  will 
be  used  in  some  initial  CTN  activities,  but  the  main  thrust  of  CTN 
user  application  testing  will  be  end-to-end  tests.  Single-ended  tests 
are  to  be  scheduled  with  the  appropriate  Service  Lead  Test  Bed  or 
the  CTNO. 


23 


User  Application  Testing 


Figure  4 
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3.3  Testing  Methodology 


Each  user  application  test  will  illustrate  the  transfer  and  use  of  at  least  one 
complete,  representative  document  from  an  important  category  of  sending 
systems  to  an  important  category  of  receiving  systems.  The  transfers  also  will 
Illustrate  the  use  of  transmission  media,  such  as  magnetic  tape.  Important 
categories  of  originating  systems  include  defense  contractor  technical  publications 
tacilities  engmeering  drawing  systems,  computer-aided  drafting/design  systems 
or  related  mdustry  or  government  repositories  for  publications  or  engineering 
data.  Receiving  systems  are  contained  in  similar  categories. 


The  CTN  testing  methodology  evaluates  the  complete  digital  data  interchange 
process  involved  m  the  transfer  of  technical  information  from  an  originating 
acihty  to  a  receiving  facility.  This  data  interchange  process  is  illustrated  in 
Hgure  5.  Data  is  created  at  the  originating  facility  during  component  design 
devebpment,  testing,  and  manufacture.  This  information  is  created  in  a  fonSat 
consistent  with  the  originating  facility's  attributes  and  requires  quality 
assurance/quahty  control  (QA/QC)  measures  and  inspections  for  technical 
accuracy  and  content.  When  the  data  is  ready  for  transfer,  it  is  translated  by  the 
sendmg  system  into  a  standard  format  that  is  acceptable  to  the  receiving  facility. 


oUowmg  data  translation,  the  deliverable  is  inspected  to  assess  that  the  di^^ital 
information  conforms  to  the  standard  format  specified  for  transfer,  and  is 
readable  and  complete.  As  part  of  this  digital  data  QA/QC  process,  the 
ongmatmg  agency  s  capability  (hardware,  software  and  procedures)  to  translate 
data  into  the  standard  format  can  be  tested  through  the  application  of 
conformance  testing. 


The  transfer  process  involves  the  creation  of  files  in  standard  format  on 
transierable  media.  Presently  the  medium  specified  by  MIL-STD-1840A  is 
9-track  magnetic  tape. 

The  process  of  receiving  information  in  digital  form  involves  the  inspection  and 
acceptance  of  the  data  as  the  completion  of  a  deliverable  product.  This 
acceptance  process  determines  data  completeness  and  whether  the  data  meets  the 
specitied  transfer  format  for  compatibility  with  the  receiving  facility.  The 
receiving  facility  may  use  the  data  in  this  standard  form  or  translate  it  into  their 
native  form.  The  receiving  translation  process  (hardware,  software  and 
procedures)  can  also  be  tested  to  determine  whether  it  can  receive  and  translate 
data  that  conforms  to  the  Standards. 
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Documents  to  be  used  in  initial  user  application  tests  will  come  from  the 
Technical  Publications  or  Engineering  Data  application  categories.  Two  types  of 
documents  may  be  found  in  each  set  of  digital  test  files  (test  set): 

•  CTNO  reference  documents  of  precisely  known  technical  content; 

•  Actual  documents  being  delivered  or  previously  delivered  between 
industry  and  government  sites. 

Normally  one  or  more  actual  documents  will  be  transmitted  for  each  of  the 
application  categories.  When  applicable,  one  or  more  reference  documents  will 
be  transmitted  for  each  of  the  four  data  format  specifications  contained  in 
MIL-STD-1840A. 

The  general  test  procedure  is  also  illustrated  in  Figure  5.  Test  data  in  hard  form 
is  provided  to  the  originating  participant,  who  is  asked  to  translate  this 
information  into  a  digital  format  utilizing  an  appropriate  CALS  Standard.  The 
hard  data  could  be  an  engineering  drawing,  illustration,  and/or  technical  manual. 
The  originating  participant  is  asked  to  provide  the  digitized  data  on  a  9-track  tape 
in  MIL-STD-1840A  format. 

In  a  user  application  test  that  is  both  end-to-end  and  a  CPT,  two  tapes  would  be 
made,  one  for  evaluation  by  the  appropriate  CTNO  test  platform  and  the  other 
sent  to  the  receiving  test  participant.  Reference  data  on  magnetic  tape  is  also 
transferred  by  CTN  to  the  receiving  facility.  The  data  on  both  tapes  are 
translated  to  the  native  format  utilized  at  the  receiving  facility  and  the  results  are 
analyzed  by  the  CTNO  technical  staff. 

During  a  user  application  test  that  is  an  IPT,  actual  design  and  production 
information  is  used  in  the  transfer.  The  intermediate  step  of  tape  analysis  by  the 
CTNO  test  platform  may  or  may  not  be  performed  depending  upon  the 
agreement  between  the  test  participants  and  CTNO. 

Each  user  application  test  will  include  these  steps: 

•  Preparation  of  the  MIL-STD-1840A  test  sets  at  an  originating  site; 

•  Transfer  of  the  test  sets  to  one  or  more  of  the  test  beds  for  evaluation  of 
adherence  to  MIL-STD-1840A  and  for  analysis  of  the  data  (this  step 
may  be  omitted  for  IPTs); 

•  Transfer  of  the  test  sets  to  the  receiving  organization  for  testing  of 
acceptance,  processing,  and  use. 
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Digital  Data  Interchange 
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Figure  5 

3.4  Implementation  of  Interchange  Testin^^ 


This  section  descnbes  the  various  combinations  of  tests  (interchanges)  that  will  be 
inaplemented  among  the  three  categories  of  test  participants.  To  qualify  for 
interchange  testing,  each  test  participant  must  have  a  facility  that  can  send  and 
receive  test  sets  in  accordance  with  MIL-STD-1840A. 

3.4.1  Industry  To  Test  Bed 

in  the  form  of  CPT  single-ended  testing  will  be 
participants  and  the  appropriate  Service 
Lead  Test  Beds.  Utilizing  MIL-STD-1840A,  industry  participants  will  provide 
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will  ^  provided  with)  digital  interchange  data  that  constitutes  the  test  set 
ihe  capability  of  organizations  to  both  send  and  receive  test  sets  will  be 
evaluated.  Preliminary  and  Final  Test  Reports  will  be  generated  for  each  test  as 
detailed  in  Subsection  2.4.3. 

3.4.2  Test  Bed  To  Government  Or  Industry  Facility 

The  appropriate  Service  Lead  Test  Bed  will  prepare  interchange  test  sets  for 
single-ended  testmg  in  accordance  with  MIL-STD-1840A  and  submit  them  for 
input  to  government  or  industry  facilities.  These  interchange  tests  will  be 
conducted  in  a  controUed  enviromnent  to  maximize  effectiveness  of  the  test  while 
mimmping  impact  on  production  sites.  Government  test  facilities  will  be 
identified  in  a  way  that  will  minimize  any  disruption  from  the  testing.  Test 
Reports  documenting  the  results  wiU  be  prepared  for  each  interchange. 

3.4.3  Industry  Facility  To  Government  Facility 

User  application  digital  data  interchanges  wiU  be  conducted  both  from  industry  to 
government  facilities  and  from  government  to  industry  facilities.  To  the 
mpimum  extent  possible  these  tests  will  utilize  actual  weapon  system  data.  In 
this  way,  the  receiving  facilities  will  benefit  both  from  what  is  learned  as  a  result 
ot  the  test  evaluation  and  from  subsequent  use  of  the  transferred  data.  Final  Test 
.  interchanges  will  document  both  the  transfer  of  data  according 

to  MIL-STD-1840A  and  the  functional  use  of  the  data  by  actual  end  users  at  the 
receivmg  facility. 

3.4.4  Government  Facility  To  Government  Facility 

^er  application  tests  will  be  conducted  between  pairs  of  government  facilities, 
these  interchanges  will  be  performed  and  documented  in  a  manner  similar  to  that 
described  in  Subsection  3.4.3. 

3.4.5  Industry  Facility  To  Industry  Facility 

User  application  tests  will  be  conducted  between  pairs  of  industry  test 
participants.  These  interchanges  will  be  performed  and  documented  in  a  manner 
similar  to  that  described  in  Subsection  3.4.3. 
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Technical  Publications  Testing 


4 


4.1  Overview 

The  application  category  "Technical  Publications"  is  defined  in  Subsection  2.1.1. 
Testing,  evaluating,  and  demonstrating  digital  data  interchange  for  Tech  Pubs 
involves  testing,  evaluating,  and  demonstrating  the  pertinent  military 
specifications  within  MIL-STD-1840A.  Currently  those  military  specifications 


For  text; 

MIL-M-28001  "Markup  requirements  and  Generic  Style  Specification 
Types  I  &  II  for  Electronic  Printed  Output  and  Exchange  of  Text  " 

(SGML) 

For  illustrations: 

MIL-D-28000  "Digital  Representation  for  Communication  of  Product 
Class  I  Data,  IGES  Application  Subsets" 

MIL-R-28002  "Raster  Graphics  Representation  in  Binary  Format, 

Types  I  &  II  Requirements  for" 

MIL-D-28003  "Digital  Representation  for  Communication  of  Illustration 

Data:  CGM  Application  Profile" 

See  Appendix  C  for  more  details  about  the  individual  specifications. 

The  other  aspects  of  MIL-STD-1840A  that  will  require  testing  for  Tech  Pubs  are 
the  tape  formatting  specifications  (the  digital  envelope)  and  the  tape  packaging 
specifications  (for  mailing)  in  the  standard  itself. 

4.2  Implementation 

Detailed  individual  tests  will  be  planned  by  Seiwice  Lead  Test  Beds  for  all  CTN 
planned  user  application  tests. 
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4.2.1  Reference  Test  Set 


A  test  set  of  known  technical  content  (reference  test  set)  has  been  constructed.  In 
addition  to  testing  the  digital  envelope,  this  set  will  be  used  to  test  the  technical 
content  of  both  the  text  (including  tables)  and  illustration  data.  The  initial 
reference  test  set  contains  SGML-tagged  text;  subsequently  It  will  be  expanded  to 
include  IGES,  Raster,  and  CGM  data.  With  the  reference  test  set  will  be 
documentation  detailing  the  contents  of  the  set  and  procedures  on  how  to  use  it. 

4.2.2  Data  Transfer  Tool  Kit  (Prototype) 

One  objective  of  MIL-STD-1840A  is  to  provide  a  means  for  transferring  large 
amounts  of  Technical  Publications  information,  not  just  one  or  two  small  test 
documents.  In  terms  of  magnetic  tape,  we  define  a  "large  volume"  transfer  as 
one  that  requires  multiple  reels  of  tape.  The  transfer  could  consist  of  a  single, 
lengthy  document  or  of  many  smaller  documents  associated  with  a  particular 
weapon  system  or  subsystem.  The  process  of  transferring  the  multiple  reels  as  a 
consistent  set  will  be  demonstrated  and  tested. 

In  order  to  handle  data  transfers  of  Tech  Pubs  data,  operations  personnel  at  both 
the  sending  and  receiving  facilities  will  require  software  tools  that  make  the 
preparation  and  receipt  of  the  test  sets  as  automated  as  possible.  This  software 
"tool  kit"  is  being  built  and  documented  by  the  CTNO  technical  operations  staff  at 
LLNL.  It  will  not  be  as  fully  developed  as  a  software  production  tool,  but  in 
prototype  form  it  will:  (1)  be  useful  for  large  volume  transfer  tests,  (2)  provide 
useful  information  for  the  development  of  production  transfer  tools,  and  (3)  be 
available  to  all  government  agencies  and  CTN  members. 


The  prototype  data  transfer  tool  kit  will  consist  of  two  categories  of  tools: 
preparation  tools  and  quality  assurance  tools.  The  preparation  tools  will  be  used 
only  by  personnel  at  the  sending  facility,  while  the  QA  tools  will  be  used  at  both 
the  sending  and  receiving  facilities.  Documentation  will  also  be  provided  that 
contains  a  step-by-step  procedure  on  how  to  use  the  tool  kit  to  generate  MIL- 
STD-1840A  compatible  magnetic  tapes. 
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4.2.3  Large  Volume  User  Application  Tests 

When  the  prototype  tool  kit  (Subsection  4.2.2)  is  available  to  participating 
organizations,  large  volume  transfer  tests  will  begin.  These  tests  will  provide 
demonstration  and  testing  of  MIL-STD-1840A  by  showing  the  automated 
interchange  of  technical  information  in  large  volume.  These  tests  will  be  used 
for  concurrent  evaluation  of  both  MIL-STD-1840A  and  the  tool  kit. 

The  large  volume  tests  will  be  based  on  file  sets  from  at  least  six  different 
sources.  The  greater  the  number  of  sources,  the  greater  the  assurance  that  the 
test  results  are  representative. 

The  principle  tasks  will  be  to  install  the  prototype  tool  kit,  implement  required 
changes  to  it,  train  selected  sending  facility  personnel  in  its  use,  and  transfer  large 
volume  test  sets.  Results  will  be  documented  with  special  attention  to 
improvements  needed  in  MIL-STD-1840A;  testing  will  also  improve  the  tool  kit. 
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Engineering  Data  Testing 


5.1  Overview 

application  category  "Engineering  Data"  is  defined  in  Subsection  2.1.1. 
testing,  evaluating,  and  demonstrating  digital  interchange  for  Engineering  Data 
involves  testing,  evaluating,  and  demonstrating  the  pertinent  military 
specifications  within  MIL-STD-1840A.  Currently  those  specifications  are: 

For  engineering  drawings: 

MIL-D-28000,  "Digital  Representation  for  Communication  of  Product 
Class  II  Data,  IGES  Application  Subsets" 

MIL-R-28002,  "Raster  Graphics  Representation  in  Binary  Format, 

Types  I  &  II  Requirements  for" 

See  Appendix  C  for  more  details  about  the  individual  specifications. 

fo"-  Classes  III,  IV,  and  V  (electrical,  NC,  and  3D  piping  & 
tubing)  will  be  addressed  by  CTN  in  the  future.  ^  » 

Other  aspects  of  MIL-STD-1840A  that  will  require  testing  for  Engineering  Data 
are  the  tape  formatting  specifications  (the  digital  envelope)  and  the  tape 
packaging  specifications  (for  mailing)  in  the  standard  itself. 

5.2  Implementation 

Detailed  individual  tests  will  be  planned  by  Service  Lead  Test  Beds  for  all  CTN 
planned  user  application  testing. 

5.2.1  Analysis  Tools 

As  a  first  step  in  implementing  testing  of  the  Engineering  Data  application 
ca  egory,  NO  will  acquire  and  evaluate  (or  develop)  the  necessary  analysis 
tools.  A  complete  Engineering  Data  tool  kit  will  consist  of  tools  to  analyze  data 

Mn  fo.n  A  specifications  (IGES  and  Raster)  and  the 

M1L-STD-1840A  digital  envelope.  Also,  a  checklist  will  be  developed  to 
compare  tapes  received  in  the  mail  against  the  tape  packaging  specifications. 
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CTNO  analysis  tools  exist  for  all  published  classes  of  MIL-D-28000  data  Tools 
have  been  developed  for  Raster  Type  I.  Tools  for  Raster  Type  II  will  be 
eveloped  m  the  future.  Some  of  these  analysis  tools  are  publicly  available* 

PTMn private  sources.  For  more  information  contact 
T  ,  Wright-Patterson  AFB  or  at  Lawrence  Livermore  National 

Laboratory  (see  Appendix  E). 

5.2.2  Reference  Test  Set 

An  adjunct  to  obtaining  the  analysis  tools  will  be  developing  reference  test  sets 
tor  each  of  the  subcategories  within  Engineering  Data.  These  test  sets  wiU  be 
used  for  analytical  evaluation  of  the  standards  along  with  preliminary 
conformance  and  acceptance  testing.  The  test  sets  will  also  be  used  for  testing  the 
analysis  tools.  As  with  the  analysis  tools,  a  complete  set  of  Engineering  Data 

will  consist  of  those  for  the  two  supporting  specifications 
(IGES  and  Raster)  with  their  accompanying  digital  envelopes.  These  reference 
data  sets  are  available  to  CTN  members  upon  request. 

5.2.3  Single-Ended  Testing 

^e  next  step  is  to  perform  single-ended  tests  at  the  Service  Lead  Test  Beds  for 
toe  purpose  of  debugging  the  analysis  tools  and  the  reference  test  sets.  Some 
osnnn  been  done  for  MIL-D-28000  Class  H.  Testing  is  planned  for  MIL-D- 

Mi-^2 

Standards  evolve,  the  analysis  tools  and  reference  test  sets  will  be 
updated.  Every  change,  correction,  or  addition  to  the  tools  or  sets  may  require 
additional  smgle-ended  testing.  ^ 

5.2.4  Large  Volume  User  Application  Tests 

As  m  the  case  with  Technical  Publications,  a  significant  test  of  Engineering  Data 
wiU  be  to  transfer  large  volumes,  not  just  a  few  drawings  or  models.  Tools  to 
nelp  prepare  and  process  hundreds  of  engineering  drawings  will  be  developed 

^he  tools  must  handle 

IGES  and  Raster  formatted  data.  This  type  of  testing  would  be  the  core  of 
the  user  application  testing. 
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APPENDIX  A 


Test  Participant  List 

This  represents  known  capability  at  the  time  of  publication.  For  current  data,  contact  the 
CTNO  or  the  appropriate  Service  Lead  Test  Bed. 

Check  marks  indicate  interest  and/or  capability.  See  comments. 


A.l  Service  Lead  Test  Beds 


Tech  Pubs 


SGML 

IGES 

Raster 

CGM 

AIR  FORCE 

HQAFLC  LMSC/SJT 
WPAFB,  OH 

V 

V 

LLNL 

Livermore,  CA 

V 

V 

V 

V 

ARMY 

Army  PM  CALS 

Fort  Monmouth,  NJ 

V 

V 

V 

V 

Engr 

Data 


IGES 

Raster 

Capabilities/Comments 

V 

V 

-  1840A:  tape  evaluation 

-  IGES:  processing,  viewing,  plotting 

-  SGML:  processing,  editing,  printing 

-  Raster:  analysis  &  plotting* 

-  CGM:  processing  &  plotting 

-  Media:  magnetic  tape,  optical  disk, 

&  network  (DDN)* 

V 

V 

-  1840A:  tape  evaluation 

-  IGES:  analysis  &  plotting 

-  SGML:  analysis  &  processing 

-  Raster:  analysis  &  processing* 

-  CGM:  processing  &  plotting 

-  Media:  maenetic  tape  &  network 

(DDN,  TYMNET,  Tl, 
Ethernet)* 

V 

V 

-  1840A:  tape  evaluation  (also 

evaluation  of  floppy  disk, 
optical  disk,  &  DDN  data 
in  1840A-like  format*) 

-  IGES:  viewing,  analysis,  editing 

&  plotting 

-  SGML:  analysis  &  processing 

-  LSAR:  full  SQL  query  capabilities 

-  Media:  magnetic  tape,  optical  disk. 

&  network  (DDN,  Tl) 
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A.l  Service  Lead  Test  Beds  (Cent.) 


Tech  Pubs 


SGML 

IGES 

Raster 

CGM 

NAVY 

David  Taylor  Research 
Center  (DTRC) 
Bethesda,  MD 

V 

V 

V 

DLA 

To  be  determined 

! 

Engr 

Data 


IGES 

Raster 

Capabilities/Comments 

V 

-  1840A:  tape  evaluation 

-  IGES:  analysis  &  plotting 

-  SGML:  processing,  editing,  & 

DTD  analysis 

-  Raster:  analysis  &  processing 

-  CGM:  to  be  determined 

-  PDES:  modeling 

-  Media:  magnetic  tape  &  network 

(DDN)* 

-  Capabilities  to  be  determined 

*  Hardware  and  some  software  are  in  place,  but  CALS  Standards  have  not  yet  been 
established  for  interchange  via  floppy  disks,  optical  disks,  nor  telecommunications. 
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A.2  Government  Test  Participants 


Engr 

Tech  Pubs  Data 


SGML 

IGES 

Raster 

CGM 

IGES 

Raster 

Comments 

AIR  FORCE 

ATOS/AFTOMS 

V 

V 

V 

V 

-  Proposed  test-DTD  development 

EDGARS  (DSREDS) 

V 

V 

-  Proposed  joint  test  with  Army; 

WR-ALC,  Robins  AFB 

SM-ALC,  McClellan  AFB 

V 

V 

V 

-  Ongoing  tests-Technical  Order  & 
Engineering  Data 

00-ALC,  Hill  AFB 

V 

-  Proposed  test-Engineering  data 

OC-AJLC,  Tinker  AFB 

-  Proposed  test-Engineering  data 

SA-ALC,  Kelly  AFB 

Aeronautical  Systems  Div 
Wright-Patterson  AFB 

V 

V 

V 

-  Plan  to  participate  in  ongoing  test- 
Technical  Order 

-  Completed  test-Engineering  data 

FIDS  Program  Office 

Tactical  Engines  Prsm 
Office 

V 

V 

V 

V 

-  Proposed  test-Technical  Order 

-  Ongoing  test-Technical  Order 

ARMY 

Army  Armament, 
Munitions  &  Chemical 
Command 

V 

V 

V 

V 

-  Proposed  test-Technical  Publication 

DSREDS  (EDGARS) 

V 

-  Proposed  joint  test  with  Air  Force 

NAVY 

Naval  Aviation  Depot 

V 

V 

V 

Naval  Ocean  Systems  Ctr 

V 

V 

Naval  Sea  Combat  Sys 
Engineering  Starion 

V 

V 

-  Completed  test-Engineering  Data 

Naval  Sea  Systems 
Command 

V 

V 

-  Proposed  test-Engineering  Data 

Naval  Undersea  Warfare 
Engineering  Station 

V 
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A.2  Government  Test  Participants  (Cont.) 


Engr 

Tech  Pubs  Data 


SGML 

IGES 

Raster  | 

CGM 

IGES 

Raster  ] 

Comments 

OTHER 

Department  of 
Transportation 

V 

V 

DOE/LLNL  Technical 
Information  Dept 

Georgia  Institute  of 
Technology 

Government  Printing 
Office 

V 

V 

V 

-  Ongoing  test;  preparing  a  plan  for 
research  and  development  of  a 

CALS  educational  program; 
planning  to  be  a  test  node. 

National  Institute  of 
Standards  &  Technlgy, 
IGES  and  PDES 

V 

V 

-  Proposed  test-PDES;  PDES  test 
platform;  leads  development  of 

IGES,  PDES,  and  CALS  Standards; 

South  Carolina  Rsrch 
Authority 

V 

V 

-  Manages  PDES,  Inc.;  Navy  RAMP 

use  Information 
Sciences  Institute 

! 

V 

V 
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A.3  Industry  Test  Participants 


Tech  Pubs 


SGML 

IGES 

Raster 

CGM 

Access  Corporation 

V 

Applied  Info  Technlgs 
Research  Center 

V 

AT&T  Federal  Systems 

V 

V 

V 

V 

AUDRE 

V 

V 

V 

V 

Auto-Trol  Technology 
Avalanche  Development 

V 

V 

V 

V 

AZTEK 

V 

Boeing  Computer  Srvcs 

V 

V 

Boeing  Military  Airplane 
Cadkey,  Inc. 

Casterline  Comptr  Cnslt 

V 

V 

CERC 

CIMLINC,  Inc. 

V 

V 

Compugraphic 

V 

V 

V 

V 

Concept  Development 
Technologies 

V 

V 

V 

V 

Context 

V 

V 

V 

V 

C-TAD  Systems 

Daisy/Cadnetix,  Inc. 

V 

V 

Datalogics,  Inc. 

V 

V 

V 

V 

Douglas  Aircraft  Co. 

Electronic  Data  Systems 

V 

V 

V 

V 

Exoterica 

V 

V 

V 

V 

Ford  Aerospace 

V 

V 

Frame  Technology 

V 

V 

V 

General  Dynamics  Data 
Systems 

V 

V 

V 

General  Dynamics  Electric 
Boat 

V 

V 

V 

V 

Engr 

Data 


IGES 

Raster 

Comments 

V 

V 

V 

V 

V 

V 

V 

V 

-  Completed  test  with  Air  Force- 
Tech  Pub 

V 

V 

-  Completed  test  with  CTNO  & 
Industry  Panicipants-Tech  Pub 

V 

-  Completed  test  with  CTNO  & 
Industry  Panicipants-Tech  Pub 

V 

-  Completed  test  with  CTNO  & 
Industry  Panicipants-Tech  Pub 

V 

V 

-  Completed  test  with  CTNO- 
Engr  Data 

V 

-  Completed  test  with  CTNO  & 
Industry  Panicipants-Tech  Pub 

V 

V 

V 

V 
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A.3  Industry  Test  Participants  (Cont.) 


Engr 

Tech  Pubs  Data 


SGML 

IGES 

Raster 

CGM 

IGES 

Raster 

Comments 

General  Dynamics,  Ft. 

V 

V 

V 

V 

V 

V 

Worth 

GE  Aircraft  Engines 

V 

GE  Corporate  Engring 

V 

V 

V 

V 

V 

V 

Grumman  Aerospace  Corp 

V 

Grumman  Data  Systems 

VI 

V 

V 

V 

V 

V 

GSC  Associates  Inc 

1 

V 

V 

V 

GTE 

V 

V 

V 

V 

V 

V 

GTX 

V 

V 

V 

Harris  Corporation 

V 

V' 

V 

V 

V 

V 

Hewlett  Packard 

V 

Honeywell  Military 

Avionics  Division 

V 

V 

V 

-  Completed  test  with  Air  Force- 

Honeywell  Ordinance  Div 

V 

Tech  Pub 

Hughes  Aircraft 

V 

i 

V 

BM 

V 

V 

V 

V 

V 

-  Completed  test  with  CTNO  & 

Industry  Participants-Tech  Pub 

IDEAL  Scanners  Inc 

V 

IGES  Data  Analysis 

V 

InterCAP  Graphics  Sys 

V 

V 

V 

Intergraph 

V 

V 

V 

V 

V 

V 

Interleaf 

V 

V 

V 

V 

-  Completed  tests  with  CTNO  & 

International  TechneGroup 

V 

Industry  Parricipants-Tech  Pubs 

J.D.  Kiser  &  Associates 

V 

V 

V 

V 

V 

V 

Knowledge  Base  Int'l 

-  Newsletter-"CALS  Repon" 

Kruse  Industries 

V 

V 

Litton  Computer  Services 

V 

V 

V 

V 

V 

V 

Lockheed  Georgia 

V 

V 

V 

-  Completed  test  with  Air  Force- 

Tech  Pub;  Ongoing  test  with 

Lockheed  Missiles  &  Space 

Air  Force,  Georgia  Tech  & 

McAir  Telecommunicarions 

CTNO-Tech  Pub 

McDonnell  Aircraft  Co. 

V 

V 

V 

V 

V 

V 

-  Completed  test  with  Air  Force,  CTN( 

McDonnell  Helicopter  Co 

V 

V 

V 

V 

V 

V 

&  Industry  Participants-Tech  Pub 
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A.3  Industry  Test  Participants  (Cont.) 


Engr 

Tech  Pubs  Data 


CO 

u 

u 

S 

CO 

cu 

o 

t/3 

o 

to 

O 

00 

o 

CO 

Dei 

8 

2 

CO 

Di 

Martin  Marietta  Data  Sys 
Martin  Marietta  Electronics 

V 

V 

V 

7 

V 

V 

V 

V 

&  Missiles  Group 

Meridian  Data  Inc 
Minigraph 

V 

V 

MITRE 

Motorola 

V 

V 

V 

V 

V 

Newport  News  Shipbldg 
Northrop  Corporation 

V 

V 

V 

V 

Pratt  &  Whitney 

V 

V 

Rockwell  International 

V 

V 

Scribe  Systems,  Inc 

V 

V 

V 

V 

Smiths  Industries 

V 

V 

V 

V 

V 

V 

Softquad,  Inc. 

V 

V 

V 

V 

STS  Information  Service 

V 

V 

V 

Sun  Microsystems 

Swedish  Institute  of 
Production  Engr  Rsrch 

V 

V 

Sydney  Communications 
Ltd. 

V 

V 

Syscon 

V 

V 

V 

V 

Texas  Instruments 

V 

V 

V 

V 

V 

V 

TRW 

V 

V 

V 

V 

V 

V 

United  States  Video  Corp 

V 

V 

V 

Vitro  Corporation 

V 

V 

V 

V 

Volt  Group 

V 

Wang 

V 

V 

V 

V 

V 

V 

Comments 


Ongoing  test  with  CTNO  & 

Industry  Participants-Tech  Pub 
Completed  tests  with  Air  Force,  CTNO 
&  Industry  Participants-Tech  Pubs; 
Ongoing  test  with  CTNO  &  Industry 
Participants-Tech  Pub 
Completed  test  with  Air  Force- 
Tech  Pub 

Completed  test  with  CTNO  &  Industry 
Participants-Tech  Pub 

Completed  test  with  CTNO  &  Industry 
Participants-Tech  Pub 


Completed  test  with  CTNO  &  Industry 
Participants-Tech  Pub 

Panicipated  in  NCGA  '89  demo 
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A.3  Industry  Test  Participants  (Cont.) 


Engr 

Tech  Pubs  Data 


SGML 

IGES 

Raster 

CGM 

1 

IGES 

Raster 

Comments 

\VESCO 

Williams  Internationa] 

Wiz  Worx 

Xerox  Special  Info  Sys 
Xyvision,  Inc. 

V 

V 

V 

V 

V 

V 

V 

V 

V 

V 

V 

V 

V 

-  Completed  test  with  Air  Force,  CTNO 
&  Industry  Participants-Tech  Pub 
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APPENDIX  B 

Format  of  Draft  Test  Plan  Document 


1 .  Introduction  and  Background 

T^is  section  contains  information  that  describes  the  circumstances  that  identified 
the  requirement  for  this  proposed  CTN  test.  It  provides  the  background  that 
qualifies  the  participant’s  ability  and  desire  to  conduct  this  CTN  test.  It  will 
wntain,  if  applicable,  the  participant's  previous  experience  and  capabilities  in 
LALS  ^d/or  in  digital  technical  data.  The  participant's  membership  on  any 
applicable  industry/govemment  committees  (such  as  CALS,  AIA,  NSIA,  NCGA 

^  j  listed.  The  type  of  user  application  test  (end-to-end  or  single- 

ended)  and  whether  IPT  or  CPT  wiU  also  be  shown. 

2.  Objective 


This  section  details  the  stated  objectives  of  the  CTN  test,  including  which 
technical  areas  of  CALS  digital  data  wiU  be  tested  and  the  expected  benefits. 

3 .  Standards  and  Specifications 

This  section  identifies  the  CALS  standards  and  specifications  that  will  be  tested 
and/or  utilized  in  this  CTN  test. 

4.  Procedures 


'^is  section  contains  the  general  and  detailed  procedures  that  will  be  utilized  in 
this  proposed  CTN  test.  The  procedures  for  the  generation  and  delivery  of  test 
items  and  how  they  will  be  tested  and  evaluated  will  be  included  in  this  section. 

5.  Facilities  and  Equipment 

This  section  lists  the  facilities,  hardware,  and  software  that  will  be  utilized  by  the 
participants.  Included  will  be  the  software  tools  (commercially  available,  public 
omam,  or  in-house  produced)  that  will  be  used  in  the  testing.  Hardware  and 
so  tware  will  be  identified  by  name,  model,  and  version  number,  including 
applicable  specifications. 
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6.  Deliverables 


This  section  identifies  the  CTN  test  reports  that  will  be  written,  and  will  identify 
each  participant's  role  in  their  review,  approval,  and  publication. 

7 .  Schedule 


This  section  contains  the  detailed  production  and  delivery  schedule 
schedule  for  the  preparation  of  the  CTN  test  reports. 

Annex  1:  Participants 


,  and  the 


This  annex  lists  aU  of  the  industry,  government,  DoD,  and  CTN  participants 

Xr,n^''miY  point(s)  of  contact,  their  addresses  and 'their 

pnone/bAX  numbers,  along  with  their  role  in  the  testing. 
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APPENDIX  C 


Overview  of  MIL-STD-1840A  Standard  and  Specifications 


C.l  MIL-STD-1840A 

MIL-STD-1840A,  "Automated  Interchange  of  Technical  Information," 
standardizes  the  digital  interface  between  organizations  or  systems  exchanging 
digital  forms  of  technical  information  necessary  for  the  logistic  support  of 
weapon  systems  throughout  their  life  cycle.  It  addresses  computer  automated 
creation,  storage,  retrieval,  and  delivery  of  data  in  the  areas  of  technical  manuals 
and  engineering  drawings.  However,  it  does  not  yet  exploit  the  full  potential  of 
emerging  computer-based  technologies  such  as  solid  modeling,  interactive 
retrieval,  and  expert  systems. 

In  particular,  MIL-STD-1840A  standardizes  the  format  and  information 
stmctures  of  digital  data  files  used  for  the  transfer  and  archival  storage  of  digital 
technical  information.  It  currently  recognizes  two  types  of  media  for  digital 
exchange:  magnetic  tape,  and  optical  disk.  However,  it  standardizes  only 
magnetic  tape  transfers  at  this  time. 

C.2  MIL-D-28000  (IGES) 


MIL-D-28000,  "Digital  Representation  for  Communication  of  Product  Data: 
IGES  Application  Subsets,"  defines  subsets  of  the  Initial  Graphics  Exchange 
Specification  (IGES)  for  various  classes  of  data,  listed  below. 

IGES  is  a  neutral  format  for  digital  interchange  of  Product  Definition  Data 
(PDD)  between  dissimilar  computer-aided  design  (CAD)  systems. 

The  classes  (unambiguous  subsets  of  IGES  entities)  specified  by  MIL-D-28000 
are: 


Class  I  -  "Technical  Illustrations."  This  is  2D  vector  data  contained 
in  illustrations  designed  for  human  interpretation. 

Class  II  -  "Engineering  Drawings."  This  is  2D  and  3D  vector  data 
such  as  that  found  in  CAD  models  and  CAD  Drawings. 
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Class  in  -  "Electrical/Electronic  Applications."  This  is  product  data 
for  printed  wiring  boards,  printed  wiring  assemblies, 
hybrid  micro-assemblies,  flexible  printed  wiring  harnesses, 
cables,  and  conventional  wiring  harnesses. 

Class  rV  -  "Geometry  for  NC  Manufacturing."  This  is  data  designed 
to  support  the  geometry  data  needs  of  process  planning  and 
numerical  control  (NC)  cutter  path  generation. 

Class  V  -  "3D  Piping  and  Tubing." 

IGES  is  the  most  widely  recognized  format  currently  available  for  moving  digital 
data  from  one  CAD  system  to  another.  An  IGES  file  may  be  used  to  create  a 
CAD  database  m  a  receiving  CAD  system.  The  IGES  file  represents  the 

information  content  of  a  private,  proprietary  CAD  database  in  a  public,  non¬ 
proprietary  form. 

C.3  MIL-M-28001  (SGML) 

MIL-M-28001,  "Markup  Requirements  and  Generic  Style  Specification  for 
Electronic  Printed  Output  and  Exchange  of  Text,"  defines  standard  DoD 
requirements  for  all  of  the  steps  involved  in  automated  publishing  of  pase 
onented  (i.e.,  printed)  technical  publications.  For  exchange  of  source  data  (prior 
to  document  composition)  it  defines  a  common  implementation  of  the  Standard 
Generali^d  Markup  Language  (SGML).  For  composition  processing  functions, 
It  will  define  an  Output  Specification  (OS)  of  typographic  page  and  format  rules; 

tor  digilay  of  the  composed  document,  it  provides  options  for  use  of  commercial 
Page  Description  Languages  (PDLs). 

MIL-M-28001  contains  rules  for  tagging  technical  manuals  according  to  the 
Docu^ment  Type  Definition  (DTD)  MIL-M-38784A/B.  A  DTD  provides  guidance 
on  the  superstructure  of  information  components  (e.g.,  titles,  subtitles,  and 
paragraphs)  within  a  document.  New  DTDs  will  be  added  to  MIL-M-28001  for 
such  documents  as  organizational  maintenance  manuals,  flight  manuals  and 
output  specifications. 

Two  types  of  data  files  currently  satisfy  the  requirements  of  MlL-M-28001: 

Type  I  -  Technical  manuals  that  conform  to  MIL-M-38784. 


Type  II  -  Technical  manuals  conforming  to  other  military  specifications. 
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C.4  MIL-R-28002  (Raster) 

for°^  Representation  in  Binary  Format,  Requirements 

SDecSv  structure  required  to  support  raster  data  interchange. 

^  ^  technical  requirements  for  raster  (bitmap)  graphtcs 

nnnlv^''^  Compressed  to  reduce  file  size  and  transmission  time.  CALS  must 

documents  and  facsimiles  (for  which  the 
emational  standard  that  MIL-R.28002  implements  was  prepared),  and  for 

tilinTirwh[rWh^^  oversize  documents.  An  option  is  included  to  use 

11  ^  ^  divided  into  a  series  of  tiles  that  can  be 

mdividuaUy  processed  to  reduce  throughput  and  terminal  storage  requirements.^ 

^n-''R"28002  identifies  two  types  of  raster  data: 


Type  I 


Type  II 


"Untiled  Raster  Graphics  Data."  This  is  single-page  raster 
data  such  as  that  found  in  digitized  images  and  digitized 
engmeermg  drawings. 

"Tiled  Raster  Graphics  Data."  Raster  data  that  can  be 
abutted  or  tiled. 


C.5  MIL-D-28003  (CGM) 

Representation  for  Communication  of  Illustration  Data* 

frPM.  n  "™  Computer  Graphics  Metafile 

(C^)  for  the  transfer  of  2D  illustrations  for  use  in  Technical  Publications 
CGM,  as  specified  in  ISO  8632,  is  a  graphics  transfer  standard  that  is  becoming 

«enerateTanfh,temmte°d"Jh  supporting  it.  CGM  files  are 

^  and  interpreted  through  translators  similar  to  IGES.  While  IGES  files 

na  yslTf  'fl^  CGM  CaS 

analysis  ot  a  file,  CGM  files  contain  only  2D  picture  or  image  data 

Consequently  the  CGM  standard  file  format  is  easier  to  interpret  and  the^file  size 
IS  much  more  compact  than  IGES. 
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APPENDIX  D 


Actions  and  Dates  for  CALS  Testing 


What  is  to  be  Tested 

Estimated  Completion  * 

Technical  Publication  Segment  1 : 

SGML  &  1st  Set  of  DTDs  &  Illustrations 

3rd  Qtr  FY-90 

Technical  Publication  Segment  2:  Output  Spec. 
&  2nd  Set  of  DTDs  &  Illustrations 

1st  Qtr  FY-91 

Technical  Publication  Segment  3:  CGM 

2nd  Qtr  FY-91 

Engineering  Drawing  Segment  1 :  IGES  I,  II 

2nd  Qtr  FY-90 

Engineering  Drawing  Segment  2:  IGES  IIL  IV 

2nd  Otr  FY-91 

Engineering  Drawing  Segment  3:  IGES  V,  VI 

TBD 

Engineering  Drawing  Segment  3:  RASTER, 

No  Tiling 

3rd  Qtr  FY-90 

Engineering  Drawing  Segment  4:  RASTER, 
Tiling 

2nd  Qtr  FY-90 

LSA/LSAR,  SQL  &  Relational  Data  Base 

2nd  Qtr  FY-91 

LSA/LSAR,  Advanced  SQL 

4th  Qtr  FY-92 

Data  Protection  &  Securitv 

TBD 

Data  Configuration  Management 

TBD 

Data  Acceptance  Procedures 

TBD 

*  At  this  date,  the  CTNO  estimates  a  95%  confidence  that  80%  of  the 
problems  with  the  standard  itself  will  have  been  found  and  corrected. 
This  is  not  to  imply  that  all  products  associated  with  the  standard  have 
achieved  this  same  level  of  accuracy. 


47 


APPENDIX  E 


Project  Office, 

Melvin  S.  Lammers 
Jo  A.  Smith 
Ronald  A.  Hall 
C.  Michael  Christie 
Andrea  D,  Carnes 
Fremont  R.  Tittle 
Leona  L.  Long 

Operations  Office, 

Peter  G.  Prassinos 
Donald  L.  Vickers 

Bruce  L,  Gamer 
JiU  M.  Farrell 
Barbara  L.  Royval 
Michele  T.  Bianchini 


CTNO  Director 
Melvin  S.  Lammers 
HQ  AFLC  LMSC/SJT 
Wright-Patterson  AFB 
Dayton,  OH  45433-5000 
(513)  257-3085 
FAX  (513)  257-2308 


CTNO  Organization  Roster 

Wright-Patterson  Air  Force  Base  (WPAFB) 

CTNO  Director 
Deputy  CTNO  Director 
Air  Force  Coordinator 
Navy  Coordinator 
Program  Analyst 
CTNO  Test  Coordinator 
Administrative  Support 


Lawrence  Livermore  National  Laboratory  (LLNL) 

CTNO  Technical  Operations  Manager 
Deputy  CTNO  Technical  Operations  Manager 
&  Tech  Pubs  Lead  Analyst 
CGM  Lead  Analyst  &  Info-X  Manager 
Engineering  Data  Lead  Analyst 
Administrative  Support 
Administrative  Support 


Points  of  Contact 

CTNO  Technical  Operations  Manager 
Peter  G.  Prassinos 
and  LLNL 

P.O.  Box  808,  L-542 
Livermore,  CA  94550 
(415)  422-4758 
FAX  (415)423-1248 
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APPENDIX  F 
References 

CTN  REPORTS  * 


Number  Title 

Sponsoi 

:  Issue  Date 

88-002  CTN  S  trategic  Test  Plan 

CTNO 

7-15-88 

89-001  The  CALS  Test  Network  MIL-D-28000  Class  II 

msjn 

1.'77-9Q 

Reference  Drawing  Packet  Revision  C 

89-003  CTN  Test  Plans 

CTNO 

5-15-89 

89-004  CTN  Testing  Philosophy 

CTNO 

3-24-89 

89-005  DSREDS/EDCARS  MIL-S 1 JJ- 1 840A  Review 

CTNO 

8-15-89 

89-006  CTN  Membership  Application/Memorandum  of  Agreement 

CTNO 

1-27-89 

89-007  CTN  Information  Exchange  Users'  Manual 

CTNO 

6-12-89 

89-008  CTN  Strategic  Plan 

ONTO 

10-11-89 

89-009  CTN  Flier 

CTNO 

4-13-89 

CTN  TEST  REPORTS  * 

Number  Title 

Sponsor 

Issue  Dafp 

87-001  Comparison  of  CCITT  Group  4  Compression  with 

CTNO 

6-08-87 

Wrap-Around  and  Standard  CCITT  Group  4  Compression 

87-002  Pratt  and  Whitney  Technical  Order  Transfer  Tests 

AF 

6-12-87 

87-003  Honeywell  Technical  Order  Transfer  Tests 

AF 

6-12-87 

87-004  Rockwell  NAAO  Technical  Order  Transfer  Tests 

AF 

6-12-87 

87-005  Boeing  Military  Airplane  Co.  Technical  Order  Transfer  Tests 

AF 

6-12-87 

88-001  Lockheed  Aeronautical  Systems  Co. Technical  Order  Transfer  Test 

AF 

12-15-88 

89-002  Engineering  Drawing  Transfer  Test  With  Douglas  Aircraft  Co, 
MIL-D-28000  Class  II  (IGES) 

CTNO 

5-02-89 

89-010  Publishing  Systems  Structured  Test  No.l 

CTNO 

to  be  released 

89-011  An  Evaluation  of  an  1840A  Magnetic  Tape  from  Interleaf  Inc. 

CTNO 

8-10-89 

89-012  Implementation  of  CCITT  Group  4  and  Wraparound 

Raster  Compression  and  Decompression 

CTNO 

to  be  released 

89-013  Publishing  Systems  Structured  Test  No.  1,  Summary  Report 

CTNO 

8-10-89 

89-014  Engineering  Drawing  Transfer  Test  Between 

Tracor  and  NA VSEACOMBATSYSENGSTA: 

CTNO 

to  be  released 

MIL-D-28000  Class  II  (IGES) 
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MILITARY  STANDARDS  ** 


lilk 

MIL-STD-1840A  with  Change  Notice  1 
(Automated  Interchange  of  Technical  Information) 

MIL-D-28000  Amendment  1 

(Digital  Representarion  for  Communication  of  Product  Data: 

IGES  Application  Subsets) 

MIL-M-28001  (SGML)  Pan  I  &  H 

(Markup  Requirements  and  Generic  Style  Specification  for 

Electronic  Printed  Output  and  Exchange  of  Text) 

MIL-R-28002 

(Raster  Graphics  Representation  in  Binary  Format,  Requirements  for) 
M^-D-28003 

(Digital  Representation  for  Communication  of  Illustration 
Data:  CGM  Application  Profile) 

MIL-HDBK-59 

(Departrnent  of  Defense  Computer-aided  Acquisition 

and  Logistic  Suppon  (CALS)  Program  Implementation  Guide) 


Issue  Date 
12-20-88 

12-20-88 

2-26-88 

12-20-88 

12-20-88 

12-20-88 


*  To  receive  copies  of  CTN  Repons  and  CTN  Test  Reports  please  contact: 

Peter  G.  Prassinos 
CTNO  Technical  Operations  Manager 
P.O.  Box  808,  L-542 
Livermore,  CA  94550 
(415)  422-4758 


*  *  To  receive  copies  of  the  Militaiy  Standards  please  contact: 

Mr.  David  S.  Bettwy 
CALS  Project  Manager 
National  Institute  of  Standards 
and  Technology  (NIST) 

Bldg.  233,  Rm.  B108 
Gaithersburg,  MD  20899 
(301)  975-6641/2 
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APPENDIX  G 


Acronyms 


1840A 

MIL-STD-1840A 

2D 

Two  Dimensional 

3D 

Three  Dimensional 

28000 

MIL-D-28000 

28001 

MIL-M-28001 

28002 

MIL-R-28002 

28003 

MIL-D-28003 

AF 

Air  Force 

AFB 

Air  Force  Base 

AFLC 

Air  Force  Logistics  Command 

AFTOMS 

Air  Force  Technical  Order  Management  System 

AIA 

Aerospace  Industries  Association 

Am 

Automated  Interchange  of  Technical  Information 

ALC 

Air  Logistics  Command 

AT&T 

American  Telephone  and  Telegraph 

ATOS 

Automated  Technical  Order  System 

CAD 

Computer-Aided  Design 

CALS 

Computer-aided  Acquisition  and  Logistic  Support 

CAM 

Computer-Aided  Manufacturing 

CCITT 

International  Consultative  Committee  on  Telegraphy  and  Telephony 

CE 

Concurrent  Engineering 

CGM 

Computer  Graphics  Metafile 

CPT 

CTN  Planned  Test 

CTN 

CALS  Test  Network 

CTNO 

CALS  Test  Network  Office 

CTNRB 

CALS  Test  Network  Review  Board 

DDN 

Defense  Data  Network 

DLA 

Defense  Logistics  Agency 

DoD 

Department  of  Defense 

DOE 

Department  of  Energy 

DQSO 

Defense  Quality  and  Standardization  Office 

DSREDS 

Digital  Storage  and  Retrieval  Engineering  Data  System 

DTD 

Document  Tv^ie  Definition 

DTRC 

David  Taylor  Research  Center 

EDCARS 

Engineering  Data  Computer-Assisted  Retrieval  System 

EDI 

Electronic  Digital  Interchange 

EIA 

Electronics  Industries  Association 

EDMICS 

Engineering  Data  Management  Information  and  Control  System 

FAX 

Facsimile 

FOC 

Full  Operating  Capability 

FP 

Financial  Plan 

FY 

Fiscal  Year 

GCA 

Graphic  Communications  Association 

GE 

General  Electric 

HQ 

Headquarters 

IBM 

International  Business  Machines 
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IGES 

Info-X 

IOC 

IPT 

ISDB 

ISO 

ITDS 

IWSDB 

LLNL 

LMSC/SJT 

LSA 

LSAR 

MIL-HDBK 

MIL-STD 

MOA 

NAAO 

NC 

NCGA 

NIST 

NSIA 

OASD 

OC-ALC 

OO-ALC 

OS 

OSD 

OTP 

PDD 

PDES 

PDL 

PM 

QA 

or 

RAMP 

SA-ALC 

SLTB 

SM-ALC 

SGML 

SP 

SPFYA 

SQL 

TBD 

Tech  Pubs 
TQM 

use 

WPAFB 

\VR-ALC 


Initial  Graphics  Exchange  Specification 

Information  Exchange  (CTN's  Electronic  Bulletin  Board) 

Initial  Operating  Capability 

Independently  Planned  Test 

Integrated  Suppon  Data  Base 

International  Organization  for  Standardization 

Improved  Technical  Data  System 

Integrated  Weapon  System  Data  Base  (CALS  Phase  II) 

Lawrence  Livermore  National  Laboratory 

Logistics  Management  Systems  Center, 

Technology  Suppon  Office 
Logistics  Support  Analysis 
Logistics  Support  Analysis  Record 
Military  Handbook 
Military  Standard 
Memorandum  of  Agreement 
North  American  Air  Operations 
Numerical  Control 

National  Computer  Graphics  Association 
National  Institute  of  Standards  and  Technology 
(formerly  National  Bureau  of  Standards) 

National  Security  Industrial  Association 

Office  of  the  Assistant  Secretary  of  Defense 

Oklahoma  City  -  Air  Logistic  Center 

Ogden  -  Air  Logistics  Center 

Output  Specification 

Office  of  the  Secretary  of  Defense 

Outline  Test  Plan 

Product  Definition  Data 

Product  Data  Exchange  Specification 

Page  Description  Language 

Project  Manager 

Qudity  Assurance 

Quality  Control 

Rapid  Acquisition  of  Manufactured  Parts 
San  Antonio  -  Air  Logistics  Center 
Service  Lead  Test  Bed 
Sacramento  -  Air  Logistics  Center 
Standard  Generalized  Markup  Language 
Strategic  Plan 

Strategic  Plan  Fiscal  Year  Annex 
Structured  Query  Language 
To  Be  Determined 
Technical  Publications 
Total  Quality  Management 
University  of  South'em  California 
Wright-Paiterson  Air  Force  Base 
Warner  Robins  -  Air  Logistics  Center 


